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INTERIM  REPORT:  DISTRIBUTED  PROBLEM  SOLVING: 
ADAPTIVE  NETWORKS  WITH  A  COMPUTER  INTERMEDIARY  RESOURCE: 
INTELLIGENT  EXECUTIVE  COMPUTER  COMMUNICATION 

1.0  INTRODUCTION 

1.1  OVERVIEW 


Problem  solving  situations  are  integral  to  our  daily  existence.  Individuals  must 
recognize,  analyze  and  solve  problems  in  order  to  achieve  goals  that  they  set  for 
themselves  or  that  others  set  for  them.  In  each  case,  individuals  may  have  access  to 
many  strategies  which  they  can  employ  to  reach  a  solution.  When  groups  of  individuals 
engage  in  solving  a  common  problem,  the  problem  solving  situation  becomes 
significantly  more  complex.  Strategies  that  groups  can  employ  to  solve  problems  may 
not  be  clear  to  the  members  of  the  group.  If  the  group  is  not  physically  colocated  (i.e., 
members  are  distributed),  problem  solving  becomes  even  more  complex  because,  not 
only  is  the  use  of  available  strategies  unclear,  but  also  their  utility  rnay  be  doubtful.  The 
purpose  of  this  report  is  to  analyze  the  requirements  for  problem  solving  strategies  for  the 
distributed  problem  solving  situation. 

In  recent  years  there  has  been  a  growing  interest  in  distributed  problem  solving, 
i.e.,  collections  of  intelligent  agents  (humans  or  intelligent  machines)  which  cooperate  to 
solve  problems.  The  motivation  for  research  in  this  area  is  to  increase  the  efficiency  and 
capabilities  of  groups  which  must  solve  problems  in  distributed  information  situations.  To 
achieve  these  goals,  strategies  for  distributed  problem  solving  must  be  developed  and 
empirically  tested.  Some  of  these  methods  may  come  in  the  form  of  "meta-level" 
functions  that  are  embedded  within  the  group  structure.  Meta-level  functions  could 
typically  include  providing  the  agents  with  high-level  knowledge  about  the  capabilities  of 
other  agents  or  providing  guidelines  on  how  and  when  to  use  the  available  resources 
(communication,  sensing,  computation,  etc.). 

This  report  presents  a  system  concept  for  an  "Intelligent  Executive."  Specifically, 
the  functional  requirements  of  a  distributed  group  of  agents  are  analyzed  along  with  the 
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characteristics  of  different  forms  of  communication.  The  Intelligent  Executive  embodies 
guidelines  for  specifying  an  appropriate  communication  strategy  given  the  problem 
environment  and  the  informational  requirements  of  the  group.  When  employed  within  a 
distributed  problem  solving  environment,  the  Intelligent  Executive  can  be  expected  to 
facilitate  the  solution  to  the  problem  by  increasing  communication  efficiency  and  problem 
solving  capabilities  of  the  distributed  agents. 

1.2  CHARACTERISTICS  OF  DISTRIBUTED  PROBLEM  SOLVING 

Distributed  problem  solving  refers  to  the  process  by  which  several  agents, 
spatially  separated,  interact  to  solve  a  problem  and  achieve  a  common  goal.  A  familiar 
metaphor  for  the  distributed  problem  solving  process  is  a  group  of  human  experts  (each 
with  individual  skills,  specialties,  and  bodies  of  knowledge)  who  are  capable  of 
sophisticated  problem  solving  and  who  cooperate  with  each  other  to  solve  a  problem.  A 
representation  for  a  distributed  problem  solving  situation  is  shown  in  Figure  1.  The 
ellipses  depicting  bodies  of  knowledge  {A,B,  and  C)  each  represent  the  combined 
skills,  knowledge,  and  capabilities  of  a  problem  solving  agent,  either  human  or  intelligent 
machine.  The  shared  knowledge,  R,  represents  the  elements  of  skills,  knowledge, 
and/or  capabilities  common  to  all  agents  within  the  problem  solving  group.  It  is  this 
commonality  that  allows  the  agents  to  functionally  communicate  and  cooperate  with  each 
other  effectively.  Consequently,  one  overall  goal  of  the  problem  solvers  is  to  increase 
the  amount  of  shared  and  common  knowledge  through  communication  until  it 
encompasses  the  solution  requirements  of  the  problem.  The  solution  requirements, 
R',  represent  the  total  resultant  shared  knowledge  that  must  be  possessed  by  the  agents 
in  order  to  achieve  a  solution  to  the  problem.  It  is  the  minimum  amount  of  commonality 
required  of  their  bodies  of  knowledge  to  be  able  to  reach  a  solution  to  the  problem  at 
hand. 
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SOLUTION  KNOWLEDGE 


Figure  1. 

Distributed  Problem-Solving  Situation 


Several  general  characteristics  of  the  distributed  problem  solving  situation  are 
particularly  important  to  understanding  the  difficulties  associated  with  this  type  of 
process.  They  may  also  affect  the  efficiency  and  productivity  of  the  problem  solving 
process.  These  characteristics  are  discussed  below. 

1.2.1  Skills:  Various  skills  such  as  sensing,  communicating,  planning,  and 
acting  are  brought  to  bear  on  the  problem  by  a  collection  of  agents. 

The  agents  may  possess  differing  levels  of  proficiency  in  all  of  these  areas. 

1.2.2  Tasks:  Unlike  the  situation  with  single-agent  problem  solving  in  which  an 
agent  has  a  global  view  of  the  problem,  tasks  must  somehow  be  assigned 

to  appropriate  agents  by  the  group  even  when  no  agent  has  a  global  view 
of  the  situation.  Tasks  must  also  be  decomposed  into,  sometimes  logically 
dependent,  subtasks. 

1.2.3  Knowledge:  An  agent  may  be  subject  to  several  kinds  of  knowledge 
limitations,  e.g.,  limited  knowledge  of  the  environment,  the  collective  set  of 
tasks  and  intentions  and  possibly  capabilities  of  other  agents. 

1.2.4  Resources:  There  are  often  limited  shared  resources  that  each  agent  can 
apply  to  tasks. 

1.2.5  Allocation:  The  appropriateness  of  a  particular  agent  for  a  task  is  a 
function  of  how  well  the  agent's  skills  match  the  expertise  required  to  do  the 
task,  the  extent  to  which  its  limited  knowledge  is  adequate  for  the  task,  its 
current  processing  resources  (problem  solving,  communication,  time,  and 
workload),  and  the  quality  of  its  communication  links  with  other  agents.  Not 
only  is  the  appropriateness  of  an  agent  to  a  task  important,  but  the  ability  for 
other  agents  to  recognize  the  appropriateness  of  an  agent  for  a  task  is 
characteristic  of  the  distributed  problem  solving  situation.  Also,  an  agent 
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may  be  unaware  of  the  fact  that  his  expertise  is  the  most  appropriate  for  a 
particular  task. 

1.2.6  Information;  As  in  many  distributed  problem  solving  environments,  the 
groupas  a  whole  may  not  have  all  of  the  information  necessary  to  solve  the 
problem.  The  dynamic  environment  provides  an  opportunity  to  discover 

new  information  and  means  for  relaying  that  information  to  the  appropriate 
me.Tibers  of  the  group. 

1.2.7  Structure;  The  structure  of  a  group  often  affects  its  performance.Structure 
refers  to  the  way  in  which  agents  are  physically  and  functionally 
interconnected.  These  include  communication  links,  dependence  links 

role  links,  power  links,  etc. 

Perhaps  the  most  comprehensive  way  to  describe  the  situation  of  distributed 
problem  solving  is  in  terms  of  what  it  is  not.  The  related  field  of  distributed  processing 
provides  a  vehicle  for  doing  just  that.  In  distributed  processing,  multiple  computers 
interact  in  a  pre-determined  fashion  through  the  sharing  of  data.  The  primary  focus  lies 
in  an  optimal  static  distribution  of  subtasks,  optimal  methods  for  interconnecting 
processor  nodes,  resource  allocation,  and  prevention  of  deadlock.  Complete  knowledge 
of  the  problem  has  also  been  generally  assumed,  while  a  major  reason  for  distribution  is 
assumed  to  be  load-balancing.  In  distributed  problem  solving,  agents  must  not  only 
share  data,  but  they  must  also  share  the  problem  solving.  Agents  must  maintain  their 
focus  on  solving  the  problem  and  possibly  developing  problem  solving  methods  during 
the  solution  process. 

Distributed  problem  solving  situations  occur  in  any  environment  in  which  the 
agents  that  possess  the  necessary  expertise  to  solve  the  problem  are  distributed 
geographically.  In  addition,  the  agents  do  not  have  direct  access  to  each  other,  but  must 
pool  their  resources  and  expertise  in  order  to  find  a  solution  to  the  problem.  In  addition. 
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the  agents  are  limited  in  their  ability  to  acquire  all  of  the  necessary  information  about  the 
problem. 

1.3  CHALLENGES  IN  DISTRIBUTED  PROBLEM  SOLVING 

The  principal  goal  of  research  in  the  field  of  distributed  problem  solving  is  to  gain 
a  fundamental  understanding  of  the  structure  and  dynamics  of  the  problem  solving 
process  when  it  includes  outputs  from  multiple  interacting  agents  (i.e.,  humans  or 
intelligent  machines).  Many  difficulties  and  opportunities  face  distributed  problem 
solvers  in  several  domains.  Many  of  these  difficulties  are  particular  to  the  multiple-agent 
situation  (however  spatially  distributed)  as  opposed  to  the  single-agent  situation. 
Following  is  a  discussion  of  the  global  problems  that  generally  characterize  the 
distributed  problem  solving  situation. 

A  dominant  challenge  in  distributed  problem  solving  is  the  tradeoff  between 
communication  and  computation.  In  most  distributed  problem  solving  situations,  the 
agents  are  capable  of  working  alone  on  subtasks  that  have  been  paititioned  from  the 
main  task  (computation)  and  occasionally  interacting  with  other  agents  (communication). 
These  interactions  generally  involve  requests  for  assistance  on  subtasks  or  the 
exchange  of  results. 

A  process  called  "task-sharing"  has  been  proposed  [Smith  and  Davis,  81]  for  use 
wherever  a  task  can  be  decomposed  into  subtasks.  This  process  allows  the  agents  to 
divide  the  workload  among  themselves.  Several  difficulties  surface  when  agents  must 
decide  which  agent(s)  will  perform  which  subtask(s).  Some  of  these  difficulties  include; 

1).  assigning  subtasks  to  the  agents  as  part  of  the  group  problem  solving  activity. 
In  single-agent  problem  solving,  the  agent  is  typically  given  its  task  as  part  of 
the  problem  definition. 
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2) .  partitioning  subtasks  to  the  appropriate  agents.  Because  of  their  incomplete 

knowledge  of  the  global  situation,  and  the  tasks  or  intentions  of  other  agents, 
the  agents  within  the  group  have  difficulty  mapping  subtasks  to  agents  with 
appropriate,  available  expertise. 

3) .  ensuring  coverage  among  ali  of  the  subtasks.  All  tasks  must  be  assigned  to 

some  agent  and  extra  or  redundant  agents  should  not  L .  assigned  subtasks. 
For  example,  in  air-traffic  control,  if  the  task  is  to  solve  a  possible  spatial 
conflict,  it  may  be  critical  to  ensure  that  only  one  aircraft  detours;  if  two  or  more 
adopt  that  role,  they  may  possibly  create  a  new  collision  situation. 

When  subtasks  cannot  be  performed  by  independent  agents  working  alone  or  if  it 
is  impossible  to  decompose  the  task  into  subtasks,  another  form  of  cooperation  may  be 
appropriate,  "result-sharing"  [Smith  and  Davis,  81].  In  this  form,  the  agents  periodically 
report  to  each  other  the  partial  results  tuey  have  obtained  during  execution  of  individual 
attempts  at  the  solution.  It  is  assumed  that  individual  agents  work  on  portions  of  the  task 
that  have  some  degree  of  commonality,  such  as  interpreting  data  from  overlapping 
portions  of  an  image.  In  this  case,  an  a  priori  partitioning  of  the  problem  exists,  agents 
simply  attempt  to  solve  that  portion  of  the  problem  which  is  most  closely  related  to  their 
individual  area  of  expertise,  or  about  which  they  have  the  greatest  amount  of  incoming 
data.  Therefore,  the  distributed  problem  solvers  may  face  severe  difficulties  in 
coordinating  task  execution.  Like  single-agent  tasks  or  subtasks,  group  tasks  may  not  be 
independent.  Temporal  or  logical  dependencies  may  exist.  In  addition,  tasks  that  are 
not  logically  connected  may  interact  through  shared  resources.  Single-agent  problem 
solvers  may  have  difficulties  in  handling  nonindependent  tasks  or  subgoals  [Sussman, 
75],  but  these  difficulties  multiply  for  distributed  problem  solvers,  because  of  their  limited 
knowledge  in  many  aspects  of  the  situation.  If  two  agents  have  only  local  knowledge 
(e.g.,  if  they  know  only  the  local  environment  and  only  their  own  tasks  and  intentions) 
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they  will  not  be  able  to  prevent  negative  interactions  between  their  actions.  Similarly, 
without  some  knov- ledge  of  others’  tasks  and  intentions,  positive  interactions,  the 
essence  of  effective  distributed  problem  solving,  will  be  discouraged.  In  summary,  a 
main  challenge  in  distributed  problem  solving  is  that  agents  must  produce  results,  which 
are  not  only  appropriate  to  the  relevant  subtask,  but  combine  effectively  with  the 
solutions  of  other  agents  solving  dependent  tasks. 

In  the  foregoing  paragraphs,  the  motivation  for  research,  the  key  characteristics 
and  the  major  challenges  of  distributed  problem  solving  have  been  presented.  Section 
2.0  presents  a  summary  of  the  major  research  issues  in  this  field  and  describes  the 
emphasis  of  future  research  relevant  to  the  distributed  problem  solving  situation.  Section 
3.0  introduces  the  concept  of  intelligent  communication  within  a  distributed  problem 
solving  environment  and  discusses  the  associated  functional  requirements.  Specifically, 
several  different  communication  protocols  are  defined  and  tactical  command  situations 
that  impose  different  communication  requirements  are  presented.  In  addition,  factors  that 
affect  the  problem-solving  ability  of  the  group  are  identified  along  with  the  knowledge 
requirements  for  intelligent  communication  via  an  "Intelligent  Executive"  or  mediator  are 
also  presented  in  Section  3.0.  The  conceptual  framework  for  analyzing  the  distributed 
problem  solving  problem  along  with  the  functional  architecture  and  processing 
requirements  of  the  Intelligent  Executive  are  presented  in  Section  4.0.  Specifically,  the 
concept  of  operation  of  the  Intelligent  Executive  is  specified  in  this  section.  Section  5.0 
offers  concluding  remarks  and  suggests  areas  for  future  research. 
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2.0  LITERATURE  REVIEW 


2.1  MAJOR  RESEARCH  ISSUES 

Many  work  products  are  identified  as  dealing  with  the  subject  of  distributed 
problem  solving;  producing  a  literature  that  is  diverse,  but  serviceable,  as  a  picture  of 
what  can  be  classified  as  distributed  problem  solving  research.  A  minimum  definition  of 
a  distributed  problem  solving  group  is  that  it  must  include  at  least  two  agents,  that  these 
agents  must  have  some  degree  of  information  and/or  control  autonomy,  and  that  some 
nonempty  subset  of  the  agents  display  some  form  of  intelligence  (capability  of  reasoning, 
planning,  problem  solving,  etc.).  This  definition,  clearly,  gives  much  leeway  as  to  what 
may  be  considered  distributed  problem  solving;  research  has  explored  many  of  the 
various  dimensions  of  distribution.  Some  of  these  will  be  discussed  in  the  following 
sections. 

Distributed  problem  solving  has  been  used  in  two  very  different  senses  in  the 
literature,  both  as  "using  artificial  intelligence  (Al)  techniques  to  find  solutions  for 
communities  of  agents"  (called  "planning  for  multiple  agents")  and  as  "using  communities 
of  agents  to  find  solutions"  (called  "distributed  problem  solving")  [Rosenschein,  82].  Each 
of  these  partial  definitions  has  a  place  in  the  developing  sense  of  what  distributed 
problem  solving  is;  however,  the  latter  problem  is  considered  the  more  difficult  of  the  two, 
and  occupies  a  central  place  in  distributed  problem  solving  research. 

Many  attempts  have  been  made  to  understand  how  groups  cooperate  effectively 
by  describing  in  formal,  computational  terms  the  actions  of  each  agent  as  the  group 
achieves  a  collective  goal.  Previous  work  in  cognitive  science  helps  little  in  achieving 
this  understanding.  Over  the  past  twenty  years,  beginning  with  the  pioneering  work  of 
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Newell  and  Simon  [Newell  and  Simon,  72],  cognitive  scientists  have  learned  much  about 
the  information  processing  that  underlies  the  problem  solving  of  individuals.  Cognitive 
psychologists  have,  for  example,  carefully  studied  the  way  in  which  people  play  games, 
solve  mathematical  problems,  and  program  computers.  In  a  similiar  way,  researchers  in 
artificial  intelligence  have  developed  computational  models  of  how  single  agents  might 
construct  biocks-worid  artifacts,  do  medical  diagnosis,  and  plan  genetics  experiments,  to 
mention  only  a  few.  These  efforts  have  resulted  in  the  development  of  a  variety  of 
techniques  for  modeling  the  environment,  planning  under  uncertainty,  and  executing 
complex  sequences  of  actions.  Unfortunately,  recent  work  suggests  that  the 
representations  of  knowledge  [Konolige,  81;  Appelt,  82]  and  planning  expertise 
[McArthur  and  Klahr,  85]  required  of  agents  in  distributed  or  group  problem  solving 
situations  are  quite  different  than  those  required  for  single-agent  problem  solvers. 
Organizational  psychologists  have  explicitly  studied  group  performance  [Dalkey,  77],  but 
because  of  the  difficulties  of  representing  multiple  disparate  world  views  and  of 
specifying  sequences  of  activities  within  and  between  agents,  their  theories  are  usually 
expressed  informally. 

Although  some  of  the  work  in  human  group  problem  solving  gives  some  insight 
into  behaviors  of  groups,  very  little  may  be  applied  to  the  distributed  problem  solving 
situation.  The  primary  difference  between  the  two  is  that  in  distributed  problem  solving, 
unlike  group  problem  solving,  each  agent  has  not  only  a  different  view  of  the  problem  but 
has  only  a  partial  view  of  the  problem.  Agents  are  limited  by  their  "sensing"  capabilities 
and  therefore  do  not  behave  in  the  same  manner  as  someone  who  has  a  global  view  of 
the  situation. 

Investigators  have  been  drawn  to  distributed  problem  solving  by  the  immense 
challenges  of  the  field  and  the  belief  in  the  ultimate  benefits  to  be  gained,  both 
intellectually  and  operationally,  from  cooperating,  distributed  agents.  There  are  many 
unsolved  problems  in  this  field,  and  current  work  has  only  begun  to  address  them;  this 
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section  outlines  some  of  the  key  issues  that  are  being  faced  in  distributed  problem 
solving  research.  The  list  is  not  composed  of  completely  distinct  items,  since  there  is 
overlap  between  some  of  these  research  topics.  Nevertheless,  the  enumeration  that 
follows  outlines  anH  emphasizes  the  primary  issues,  and  is  a  useful  means  of  organizing 
them  for  better  understanding. 

2.1.1  Global  coherence  out  of  local  actions 

One  important  high-level  issue  in  distributed  problem  solving  is  how  to  achieve 
global  coherence  out  of  the  many  local  actions  taken  by  a  distributed  group.  By  global 
coherence,  we  mean  that  the  end  result  of  the  group's  activity  should  have  certain 
desirable  properties;  these  properties  may  differ  depending  on  the  group,  but  usually 
include  such  things  as  correctness,  or  agreement  on  a  "final  answer"  either  by  all,  most 
or  some  significant  subset  of  the  agents. 

The  distributed  problem  solving  requirement  of  autonomy  is  crucial;  clearly,  if  all 
local  actions  are  dictated  by  a  central  authority  (with  its  own  utility  function)  then  those 
local  actions  serve  the  centrally  dictated  common  good.  When  local  agents  have  control 
over  their  own  actions,  however,  and  have  their  own  goals  and  their  own  utility  functions, 
then  they  will  pursue  their  own  or  the  group’s  interests  as  they  perceive  them.  The 
question  then  arises  of  how  these  locally  motivated  agents  can  be  guided  so  as  to  fulfill 
some  global  goals.  Dictating  certain  principles  to  agents  is  an  option,  but  the  issue  of 
which  principles  of  cooperation  should  be  utilized  is  still  unsettled. 

2.1.2  Organization  paradigms 

Closely  related  to  the  issue  of  globally  coherent  actions  is  that  of  organization 
structures.  Deciding  how  to  structure  a  group  of  agents  (that  is,  deciding  how  they  will 


interact  in  terms  of  control  and  communication)  is  a  crucial  first  step  in  achieving 
coherent  interaction.  Several  organization  paradigms  have  been  explored  by  distributed 
problem  solving  researchers  in  their  search  for  effective  control  schemes:  unstructured 
communication  (i.e.,  total  connectivity  among  agents)  [Hewitt,  80],  hierarchical 
organizations  [Corkill  and  Lesser,  83;  Wesson,  et.al.,  80],  selectively  connected  nets  of 
agents  [Lesser  and  Erman,  80;  Christie,  54],  etc.  The  underlying  paradigms  of  inte-action 
within  these  organizations  have  also  been  varied;  some  researchers  have  used  an 
economic  model  of  interaction  [Doyle,  85;  Malone,  82],  some  have  used  "master/slave' 
analogies  [Rosenschein,  82],  some  biological  analogies  [Kennedy,  62],  while  yet  others 
have  theorized  totally  cooperative  agents  [Davis  and  Smith,  81]. 

The  work  on  organizational  paradigms,  like  much  else  in  distributed  problem 
solving,  remains  in  its  infancy.  Examination  of  this  issue,  in  conjunction  with  other, 
related  issues  such  as  control,  leaves  much  work  for  the  future. 

2.1.3  Distribution  of  control 

Inextricably  connected  with  the  question  of  global  coherence  is  that  of  control 
schemes:  how  should  the  individual  agents  in  a  distributed  group  be  controlled  (so  as  to 
further  some  global  utility  function)?  The  essence  of  this  question  lies  in  how  group 
control  should  be  distributed.  At  one  end  of  the  spectrum  there  are  groups  where  all 
control  is  exercised  by  a  single  authority  (though  the  agent  that  is  "controller"  at  any 
given  time  or  for  any  given  task  may  change)  [Rosenschein,  82].  At  the  opposite  end  are 
groups  of  totally  autonomous  agents  whose  only  control  over  one  another  Is  through 
requests  that  may  be  refused.  In  the  middle  lie  systems  [Lesser  and  Corkill,  83]  whose 
agents  interact  through  subtle  processes  of  hypothesis  or  desire  transferral;  control  is 
exercised  through  a  weighting  of  importance  between  an  agent's  own  desires  and/or 
hypotheses  and  the  desires  and/or  hypotheses  of  other  agents. 
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The  advantage  of  centralized  control  is  clear;  global  considerations,  at  least  to  the 
extent  they  are  seen  by  the  central  agent,  can  be  easily  and  directly  translated  into 
pertinent  actions,  and  there  is  virtually  no  trouble  in  achieving  global  coherence.  With 
distributed  control,  on  the  other  hand,  decisions  can  be  made  without  the  bottleneck  of  a 
central  decision  maker  by  reducing  processing  pressure  at  the  center.  Local  reaction 
time  car,  be  improved  and  vulnerability  of  the  whole  can  be  reduced.  Distributed  control 
may  also  be  more  suitable  to  the  specifications  of  a  particular  problem  or  the 
requirements  for  the  form  its  solution  should  take  (political  or  operational).  In  any  case, 
group  control  needs  to  be  understood  more  fully  for  distributed  problem  solving  groups  to 
operate  efficiently;  this  becomes  especially  critical  in  large  groups,  consisting  of  more 
than  just  a  few  agents  (where  simpler  control  schemes  fail  to  produce  satisfactorily 
efficient  behavior).  While  some  preliminary  research  has  been  pointed  in  this  direction 
[Corkill,  80];  much  remains  to  be  done. 

2.1.4  Incomplete,  possibly  Inconsistent,  views  of  the  world 

When  problem  solving  investigators  began  exploring  distribution,  one  of  the  first 
new  problems  they  encountered  was  that  of  differing  world  views  among  agents.  Before, 
research  had  dealt  with  a  single  agent  whose  view  of  the  world  was  often  assumed  to  be 
correct.  The  move  to  distribution  argued  against  continuing  to  work  with  this  simplifying 
assumption,  whose  plausibility,  in  any  case,  had  never  been  very  high.  In  particular, 
when  agents  are  independently  performing  actions,  it  is  unreasonable  (especially  in 
large  groups)  to  update  every  agent’s  view  of  the  situation  after  each  action.  Thus,  with 
several  agents  it  seems  realistic  to  expect  variations  among  the  world  models  of  the 
agents;  at  the  very  least,  we  might  expect  gaps  in  the  knowledge  of  agents,  where  agent 
A  knows  something  that  agent  B  doesn't  know.  A  more  extreme  assumption  is  that 
agents  have  conflicting  beliefs. 
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Research  has  focused  on  how  agents  can  communicate  knowledge  about  the 
world  to  each  other;  a  less  well-developed  area  of  investigation  has  been  belief  revision, 
how  beliefs  that  are  discovered  to  be  incorrect  can  be  corrected  by  a  better  informed 
agent.  In  cases  of  both  "knowledge  gaps"  and  "incorrect  knowledge,"  coherent  action 
will  often  require  agents  to  have  overlapping  models  of  relevant  parts  of  the  world. 
Lacking  harmonious  beliefs  as  to  the  siate  c:  this  model,  two  agents  will  rarely  be  able  to 
cooperate  in  achieving  a  particular  goal  state. 

2.1.5  Communication  vs.  Computation 

There  is  a  tradeoff  to  be  made  between  communication  and  computation  in 
distributed  groups.  It  will  often  be  the  case  that  certain  information  is  needed  (about  the 
world  or  about  another  agent)  and  could  be  gained  in  one  of  two  ways:  through  querying 
of  an  agent  who  already  has,  or  can  more  readily  obtain,  the  information:  or  by 
performing  the  necessary  computation  to  answer  the  question  oneself  (when  this  is 
possible).  Similarly,  if  an  agent  has  a  rich  enough  model  of  another  agent’s  beliefs  and 
reasoning  processes,  he  could  deduce  that  agent's  actions  through  computation  in  place 
of  direct  communication  and  querying.  The  circumstances  under  which  computation 
should  be  used  in  place  of  communication  is  an  open  research  topic.  Relevant 
considerations  include  the  relative  costs  of  the  two  options,  limitations  on  the 
communication  bandwidth,  limitations  on  effective  processing  time,  concerns  about 
communication  secrecy  (e.g.,  wanting  to  limit  communication  in  certain  circumstances), 
and  expectations  of  either  method's  successfully  providing  the  information  desired. 

In  distributed  problem  solving  groups,  the  assumption  of  limited  bandwidth  (setting 
maximum  limits  on  the  amount  of  communication  over  time)  is  almost  universal.  This  is 
because  limited  bandwidths  dominate  groups  in  the  real  world,  and  also  because  it  is  a 
powerful  motivating  assumption  (guaranteeing  autonomy  among  agents,  a  "loosely- 


coupled"  system).  Communication  is  assumed  to  be  limited  and  more  costly  than 
computation  using  some  metric  of  cost.  Without  this  supposition,  the  system  becomes 
strongly  linked  and  more  like  a  distributed  processing  environment,  rather  than  a 
collection  of  independent  agents. 

When  a  decision  is  to  be  made  between  communication  and  computation,  there  is 
the  meta-leve!  issue  of  hcv;  much  computation  should  be  expended  on  making  the 
decision  itself  [Barnett,  84;  Rosenschein  and  Singh,  83].  In  any  case,  very  little  is 
understood  about  how  this  decision  should  be  made  and  the  heuristics  that  might 
intelligently  guide  the  process  [Lesser  and  Erman,  80). 

2.1.6  Resource  tradeoffs 

Related  to  the  notion  of  communication  vs.  computation  is  the  more  general 
problem  of  resource  tradeoffs.  In  distributed  problem  solving  groups,  it  is  often  possible 
to  devise  several  plans  to  accomplish  some  goal;  each  of  these  plans  may  have  things 
that  recommend  its  implementation.  For  example,  consider  a  plan  to  format  a  computer 
file  and  print  it  out.  If  the  file  is  located  at  site  A,  and  the  printing  should  go  on  at  site  B, 
where  should  the  formatting  take  place?  Considerations  include  the  availability  of  the 
necessary  formatting  software  at  the  two  sites,  the  cost  of  doing  the  formatting  at  each 
site,  the  load  on  each  computer,  the  size  of  the  formatted  and  unformatted  files,  the  cost 
of  file  transmission,  etc.  It  is  necessary  to  consider  these  aspects  when  devising  a  plan, 
and  to  trade  off  some  resources  in  favor  of  others. 

2.1.7  Synchronization  of  activities 

When  agents  are  performing  actions  independently,  there  is  the  danger  that  those 
actions  might  interfere  with  one  another.  Even  in  situations  where  their  actions  can  be 
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guaranteed  to  combine  coherently  into  an  overall  plan  (through  the  use,  for  example,  of  a 
central  planner),  there  is  the  danger  that  actions  will  be  taken  in  the  wrong  order  once 
they  are  parceled  out  to  separate  agents.  Early  research  on  this  topic  has  been 
characterized  by  two  distinct  approaches:  1).  centrally  formulating  plans  so  that  they 
contain  the  requisite  synchronization  primitives  (i.e.,  synchronizing  the  actions  of  agents) 
[Rosenschein,  82],  and  2).  modifying  the  separate,  already  existing  plans  of  agents  so 
that  they  do  not  conflict  [Georgeff,  83],  focusing  on  limiting  the  combinatorial  explosion 
implicit  in  examining  plan  interleavings).  Work  on  synchronization  in  relatively  well- 
developed,  though  other,  possibly  superior,  approaches  could  be  undertaken  in  the 
future. 

2.1.8  Task  decomposition 

Even  when  a  plan  has  been  fully  constructed,  there  remains  the  question  of  how  it 
should  be  distributed  through  the  system,  that  is,  what  agents  should  carry  out  what  parts 
of  the  plan.  This  question  has  been  partly  dealt  with  in  analysis  of  algorithms  (articles  on 
scheduling)  [Dolev,  80;  Graham,  69;  Helmbold  and  Mayr,  84;  Mayr,  81],  in  systems 
[Ackerman,  82]  and  in  artificial  intelligence  [Rosenschein  and  Singh,  83;  Singh  and 
Genesereth,  84]. 

Although  the  scheduling  problem  (in  all  but  trivial  incarnations)  is  difficult,  powerful 
and  simple  heuristics  have  been  found  to  aid  in  the  distribution  decision.  Nevertheless, 
there  remain  many  areas  for  improvement.  Not  enough  consideration  has  been  given  to 
the  varied  nature  of  system  agents;  some  agents  are  capable  of  performing  certain  tasks 
but  not  others,  or  can  perform  certain  tasks  very  quickly.  These  considerations  need  to 
be  taken  into  account  in  the  distribution  heuristics.  Currently,  a  simplifying  assumption  is 
often  made  that  all  agents  are  identical  in  their  capabilities.  Ideally,  the  group  should 
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also  use  information  about  agents  and  their  capabilities  in  constructing  the  plan,  and  in 
dividing  it  into  pieces  for  distribution. 

2.1.9  Reliability  and  redundancy  considerations 

One  of  the  hopes  for  distributed  problem  solving  is  that  it  will  enable  distributed 
groups  to  operate  with  increased  reliability.  To  accomplish  this  goal,  however,  there 
needs  to  be  more  understanding  of  the  tradeoffs  involved  in  achieving  greater  reliability. 
For  example,  one  possible  way  of  having  a  distributed  problem  solving  group  fail  less 
often  would  be  for  all  actions  to  be  performed  by  all  agents  (where  such  overlap  is 
possible).  While  this  would  increase  reliability  through  increased  redundancy,  the  cost 
would  clearly  be  prohibitive  in  real  systems.  A  lesser  amount  of  redundancy  is  possible 
(with  a  correspondingly  lesser  amount  of  reliability),  of  course,  but  exactly  how  much 
reliability  is  called  for  in  a  particular  situation,  and  how  is  this  best  achieved?  While  work 
in  this  area  is  sketchy  (and  has  been  pursued  on  a  mainly  intuitive  basis  by  computer 
systems  researchers),  it  could  be  a  rewarding  area  for  future  distributed  problem  solving 
research. 

2.2  CURRENT  RESEARCH  EMPHASIS 


Distributed  problem  solving  researchers  have  pursued  their  aim  of  designing 
cooperating  agents  in  a  variety  of  ways.  This  section  briefly  categorizes  some  of  the 
approaches  taken.  Researchers  have,  for  the  most  part,  stayed  within  the  boundaries  of 
some  particular  category,  with  cross-over  being  rare.  This,  however,  may  change  as  the 
field  matures,  and  scientists  consider  complementary  ways  of  approaching  their  research 
problems. 
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2.2.1  Experimentation 


Several  researchers  have  approached  distributed  problem  solving  with  an 
experimental  bent,  building  simulations  of  distributed  cooperative  groups  and  then 
conducting  performance  tests  to  judge  how  they  work  under  a  variety  of  parameter 
values.  Most  notable  among  these  researchers  are  Lesser,  Erman  and  Corkill  [Lesser 
and  Corkill,  83;  Lesser  and  Erman,  80],  and  Smith  [SIGART,  82].  This  approach  has 
quite  a  bit  to  recommend  it,  given  the  still  rudimentary  state  of  knowledge  about 
distributed  problem  solving.  Hard  data  is  badly  needed  .  However,  some  theoretical 
foundation  is  needed,  and  though  much  illuminating  research  has  been  done  through 
distributed  problem  solving  experiments,  the  work  suffers  from  a  relative  abundance  of 
scattered  data  and  few  organizing  principles.  Fortunately,  these  principles  are  beginning 
to  emerge  [Corkill  and  Lesser,  81 ;  Corkill,  Lesser  and  Hudlicka,  82]. 

2.2.2  Formalized  theories  of  knowledge  and  belief 

Part  of  the  work  in  distributed  problem  solving  is  currently  directed  towards 
developing  formal  theories  of  knowledge  and  belief  [Appelt,  82;  Konolige,  83).  This  work, 
mainly  taking  place  at  SRI,  grew  out  of  the  (single  agent)  work  in  knowledge  and  belief 
pioneered  by  McCarthy  and  by  Moore;  the  SRI  researchers  are  extending  the  concepts 
(and  developing  new  ones)  for  the  multiple-agent  domain.  Recent  work  out  of  Stanford 
University  [Moses,  86]  specifically  addresses  the  role  of  knowledge  in  a  distributed 
environment.  A  general  framework  for  defining  knowledge  in  a  distributed  system  is 
given.  These  research  efforts  are  of  great  interest  and  importance  within  both  the 
distributed  problem  solving  community  and  the  problem  solving  community  as  a  whole;  a 
major  concern  about  the  approaches  being  taken,  however,  has  to  do  with  whether  the 
efficiency  of  their  implementations  will  be  sufficient  for  applications  .  For  example,  some 
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of  their  representations  make  use  of  the  semantics  of  possible  worlds,  and  this  has  led  to 
inefficient  computation.  As  work  continues  on  improving  these  representation  schemes, 
progress  can  also  be  expected  in  making  them  computationally  more  tractable. 

2.2.3  Principles  of  cooperation 

Some  distributed  problem  solving  researchers  have  devoted  their  time  to 
developing  "principles  of  cooperation."  which  should  guide  the  actions  of  cooperative 
agents  [Davis,  81 ;  Wesson  et.al.,  80].  These  principles  comprise  such  rules  of  thumb  as 
having  agents  act  predictably,  and  committing  themselves  as  late  as  possible  to  any 
particular  restrictive  course  of  action.  The  work  on  such  principles  was  a  worthwhile  first 
step  towards  cooperative  system  design;  unfortunately,  the  groundwork  has  not  been 
followed  by  concrete  implementations  of  these  principles  in  working  groups.  It  is  difficult 
to  determine  if  this  is  because  an  inate  "fuzziness"  in  the  approach  precluded  successful 
follow-up  work,  or  whether  other  considerations  applied.  In  any  case,  some  of  these 
principles,  having  been  explicated,  may  find  their  way  into  future  distributed  problem 
solving  implementations  by  the  same  investigators  or  others. 


3.0  INTELLIGENT  EXECUTIVE  FUNCTIONAL  REQUIREMENTS 


3.1  OVERVIEW 


Distributed  problem  solving  agents  typically  operate  in  an  uncertain  environment 
in  which  they  need  to  rely  heavily  on  their  own  knowledge,  expertise  and  information 
gathering  abilities.  But  in  order  to  effectively  pursue  and  accomplish  a  common  goal,  the 
agents  need  to  intelligently  communicate  their  local  "news"  and  coordinate  their  mutual 
actions.  It  is  well  recognized  from  distributed  problem  solving  literature  that 
communication  and  cooperation  are  the  underpinnings  that  promote  group  synergy. 
Cooperation  is  the  means  by  which  a  group  optimally  utilizes  and  exploits  its  mutual 
strengths  and  circumvents  its  weaknesses.  Communication  among  distributed  agents  is 
a  function  which  allows  those  agents  to  cooperate.  Although  communication  between 
agents  is  necessary  for  effective,  cooperative,  problem  solving,  it  is  just  another 
contributing  factor  to  problem  solving  that  may  or  may  not  be  used  effectively. 
Considerable  expertise  is  required  for  effective  communication.  Such  expertise  is 
required  to  explicitly  assess  the  specific  benefits,  costs  and  risks  of  different 
communication  strategies  over  different  problem  solving  situations. 

This  report  presents  a  system  concept  for  intelligent  communication  and 
cooperation  in  an  Intelligent  Executive.  The  Intelligent  Executive  is  defined  as  an  agent 
that  possesses  meta  knowledge,  i.e.,  knowledge  about  the  knowledge  that  each  of  the 
agents  possesses.  Given  this  knowledge,  the  Intelligent  Executive  is  able  to  assess  the 
benefits,  costs  and  risks  associated  with  the  different  communication  strategies  within  a 
particular  problem  solving  situation.  On  this  basis,  the  Intelligent  Executive  is  able  to 
select  the  appropriate  communication  strategy  for  the  group.  This  section  presents  the 
relevant  communication  strategies  and  the  different  situations  within  which  the  functional 
requirements  are  specified,  along  with  the  cost  and  risk  factors  that  may  be  present  in  the 
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environment.  The  section  ends  with  the  specification  of  the  knowledge  requirements  of 
an  Intelligent  Executive. 

3.2  COMMUNICATION  PROTOCOLS 


Decisions  about  when  and  how  one  agent  should  communicate  with  another  are 
continuously  required  throughout  the  distributed  problem  solving  process.  The  different  forms 
of  communication  or  communication  strategies  are  technically  known  as  "communication 
protocols."  Communication  protocols  provide  the  types  and  degree  of  restrictions  (if  any)  on 
message-passing  among  intelligent  agents.  Three  communication  protocols  that  may  exist 
within  the  distributed  problem  solving  situation  are  discussed  below.  Tablet  summarizes  the 
advantages,  disadvantages  and  underlying  assumptions  of  each. 

3.2.1  Broadcast:  Broadcast  communication  is  an  indiscriminate  form  of 
communication.  Any  agent  can  transmit  information  simultaneously  to  all  other  agents  within 
the  group.  Because  of  the  ability  to  communicate  to  all  agents,  this  protocol  allows  the 
agents  to  quickly  acquire  a  complete  view  of  the  problem  and  the  surrounding  environment. 
In  addition,  by  sharing  their  knowledge  of  the  situation  with  others,  the  agents  can  rapidly 
increase  the  amount  of  common  information  within  the  group.  Whenever  a  group  of  agents 
communicate  among  themselves,  the  issue  of  relevancy  becomes  important.  Some  of  the 
transmissions,  or  messages,  may  only  be  relevant  to  a  few  agents  within  the  group. 
Therefore,  if  an  agent  receives  too  much  irrelevant  information,  there  is  a  greater  chance  of 
confusion  or  misinterpretation  on  the  part  of  the  agent.  Such  interference  could  ultimately 
inhibit  the  progress  of  the  group. 
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Table  1. 

Communication  Protocols 
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of  characteristics  or  capabilitiesof  sQn(j  messages  knowledge,  data  and  information 

other  agents  .  agents  must  be  aware  of  who  gathering  abilities 

needs  what  information 
-  agents  must  be  aware  of  who  can 
supply  what  information 


An  advantage,  however,  is  that  whenever  a  messge  is  relevant  to  an  agent,  that  agent  is 
sure  to  receive  it  under  the  broadcast  protocol. 

The  greatest  disadvantage  of  the  broadcast  protocol  stems  from  the  fact  that  a 
copy  of  the  message  being  transmitted  must  be  st  nt  to  each  of  the  other  agents  within 
the  group,  or  it  is  sent  in  a  form  which  allows  am'one  with  receiving  and  deciphering 
capabilities  to  intercept  it.  A  situation  may  exist  where  there  is  a  risk  either  of  the 
message  being  intercepted  by  an  "opposing"  agent  (e.g.,  a  confidential  memorandum  in 
a  corporate  environment)  or  of  giving  away  the  physical  location  of  the  transmitting  agent 
(i.e.,  detection  during  military  communication  in  enemy  territory).  In  these  situations  it 
would  be  to  the  group's  advantage  to  limit  the  number  of  messages  sent  within  this 
protocol. 

Finally,  an  underlying  assumption  within  this  protocol  is  that  agents  do  not  have  to 
be  aware  of  the  characteristics  or  capabilities  (e.g.,  knowledge,  skills,  expertise,  etc.)  of 
other  agents  in  the  group.  An  agent  can  be  assured  that  a  message  which  is  relevant  to 
a  particular  agent  will  be  sent  to  that  agent.  It  is  not  incumbent  upon  the  sender  of  the 
message  to  determine  the  most  appropriate  receptor  of  that  message. 

3.2.2  Selective:  The  selective  communication  protocol  is  more  conservative  in 
nature.  Under  this  protocol,  agents  must  select  one  agent  to  which  to  transmit  a 
message.  Subsequently,  one  transmission  of  that  message  is  sent  only  to  the  selected 
agent.  Therefore,  it  is  assumed  that  agents  must  be  aware  of  which  agents  need  what 
information  and  which  agents  can  supply  what  information.  This  may  introduce  a  large 
decision  making  component  into  the  communication  environment.  Although  the  agents 
may  sometimes  select  an  inappropriate  agent,  they  implicitly  reduce  the  amount  of 
irrelevant  information  that  is  distributed  to  other  agents.  While  this  may  reduce  the 
chance  of  confusion  or  misinterpretation,  it  also  reduces  the  rate  at  which  agents  acquire 
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a  more  complete  view  of  the  problem  and  the  environment.  In  addition,  it  reduces  the 
rate  at  which  the  amount  of  common  information  among  agents  is  increased. 

A  desirable  feature  of  the  selected  protocol  is  that  the  chance  of  allowing  message 
interceptions  or  agent  detections  may  be  lower  than  under  the  broadcast  protocol  (all 
other  factors  being  equal).  Therefore,  in  situations  where  the  threat  of  interceptions  or 
detection  is  high,  the  selective  protocol  may  be  preferred  over  the  broadcast. 

3.2.3  Autonomous:  The  most  restrictive  form  of  communication  to  be  discussed 
is  the  autonomous  communication  protocol.  No  messages  are  transmitted  under  this 
protocol.  The  agents  must  rely  on  their  own  knowledge,  skills,  data  and  information 
gathering  abilities.  Several  of  the  benefits  of  this  protocol  include: 

•  no  chance  of  allowing  interceptions  of  messages  or 
detections  of  agents. 

•  no  cost  in  terms  of  time  in  transmission. 

•  agents  do  not  receive  irrelevant  information  that  may 
cause  confusion  or  misinterpretations. 

In  situations  where  the  risks  of  uncontrolled  communication  are  too  high  to  justify 
other  protocols,  the  autonomous  protocol  may  be  selected.  Obviously,  there  are  many 
disadvantages  associated  with  selecting  this  protocol.  Most  importantly,  the  agents 
probably  will  not  acquire  a  complete  view  of  the  problem  or  the  environment.  They 
probably  will  not  efficiently  increase  the  amount  of  common  information  among  them. 

The  agents  become  completely  isolated  from  each  other.  Their  only  knowledge  of  the 
other  agents  or  of  the  actions  of  other  agents  must  be  inferred  from  the  changes  which 
take  place  in  the  scenario  or  environment  due  to  the  existence  of  other  agents  and  the 
results  of  their  actions. 
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ideally,  appropriate  communication  protocols  are  selected  by  weighing  the 
advantages  and  disadvantages  of  each  as  they  pertain  to  a  particular  problem  situation. 
The  problem  "s.tuation"  is  usually  a  function  of  the  objective  or  goal  of  the  problem 
solving  group  and  the  cost  and  risk  factors  associated  with  the  environment  or  scenario. 
Usually  the  problem  solvers  must  trade  off  the  benefits  of  one  form  of  communication 
against  the  costs  and/or  risks  within  the  environment,  especially  near  "acceptable"  limits. 
In  order  to  describe  the  nature  of  the  relationship  between  communication  protocols  and 
the  associated  costs  or  risks,  this  report  will  present  four  examples  of  military  command 
situations.  The  command  situations  will  provide  a  contextual  backdrop  on  which  to 
describe  the  requirements  of  the  Intelligent  Executive.  The  four  command  situations 
below  were  selected  for  several  reasons: 

•  they  correspond  to  different  phases  within  a  military  mission. 

•  each  has  a  different  objective  within  the  overall  mission. 

•  the  importance  of  communication  differs  in  each. 

•  the  emphasis  of  costs  and  risks  associated  with 
communication  differ  in  each. 

Each  situation  is  described  below  by  identifying  the  objective  and  the  importance  of 
communication  within  the  situation.  Table  2  summarizes  the  following  discussion. 

3.3.1  Mobilization:  The  objective  of  the  mobilization  phase  is  to  organize  and 
deploy  the  friendly  forces.  In  addition,  the  commanders  must  prepare  and  maintain  an 
overall  strategic  posture  which  is  based  on  information  concerning  the  enemy's 
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Table  2 

Command  Situations 
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capabilities.  Communication  plays  an  important  role  when  several  commanders  must 
coordinate  their  plans  in  an  effort  to  make  appropriate  deployment  decisions. 

3.3.2  Reconnaissance:  The  primary  focus  of  a  reconnaissance  mission  is  to 
collect  information  on  the  enemy  and  its  capabilities  without  being  detected  (assuming 
retaliation  is  possible).  Communication  allows  the  reconnaissance  teams  to  relay  their 
items  of  informuion  to  the  command  post  so  that  the  decisionmakers  may  acquire  a 
"complete  picture"  of  the  battlefield  situation. 

3.3.3  Combat:  In  general,  the  objective  of  the  combat  phase  of  a  mission  is  to 
coordinate  the  friendly  forces  so  that  they  may  defeat  the  enemy  by  effectively  using 
tactics  and  resources.  Communication  is  extremely  important  in  this  circumstance  only 
when  it  is  timely.  Critical  information  must  be  passed  to  each  unit  quickly  so  that  the 
commanders  may  coordinate  their  actions  to  succeed. 

3.3.4  Withdrawal:  The  critical  factor  in  the  withdrawal  phase  is  to  maintain  a 
strong  posture.  In  other  words,  the  commanders  must  coordinate  their  plans  so  that  one 
unit  is  not  left  vulnerable  to  the  enemy.  Communication  may  insure  this  coordination  so 
as  to  prevent  the  collapse  of  the  defensive/offensive  posture. 


3.4  COMMUNICATION  FACTORS 

Although  the  overall  goal  of  the  distributed  group  is  to  have  a  successful  mission, 
each  phase  of  the  mission,  or  command  situation,  has  a  different  objective.  In  addition, 
the  importance  of  certain  cost  and/or  risk  factors  associated  with  the  environment  or 
scenario  varies  within  each  command  situation.  Selection  of  an  appropriate 
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communication  protocol,  therefore,  is  largely  dependent  upon  the  impact  of  the  cost  and 
risk  factors  on  the  ability  to  achieve  the  situation  objective.  For  example,  if  a  successful 
reconnaissance  mission  depends  heavily  on  avoiding  detection  by  the  enemy,  then  it  is 
safe  to  assume  that  a  broadcast  communication  protocol  is  not  an  appropriate  selection. 
However,  situations  are  not  always  as  simple  as  that.  Factors  such  as  timeliness  of  data, 
accuracy  of  transmissions,  enemy  detection  and  retaliation  capabilities,  etc.  must  be 
considered  before  a  decision  on  communication  protocol  can  be  reached.  The  following 
is  a  discussion  of  several  cost  and  risk  factors  which  must  be  considered  as  part  of  the 
overall  protocol  selection  process. 


3.4.1  COST  FACTORS:  Cost  factors  can  be  defined  as  characteristics  of  the 
environment  or  instances  that  occur  in  the  scenario  that,  when  present,  hinder  the 
solution  process  in  some  way.  These  factors  may  be  present  throughout  the  problem 
solving  process  or  may  occur  only  at  certain  times  during  the  process.  Either  way  they 
have  a  negative  effect  on  the  ability  of  the  agents  to  achieve  the  mission  objective  or 
simultaneously  or  subsequently  achieve  some  other  mission.  Cost  factors  include: 

•  Agent  Avallability/Unavilability:  Whenever  the  effectiveness  of  an 
agent  in  the  group  is  "lost",  information  that  agent  had  or  had  the  ability  to  acquire 
are  lost  or  non-information  capabilities  such  as  firing  a  weapon  are  lost.  For 
example,  an  agent  could  experience  a  mechanical  or  electrical  failure  which 
would  prevent  it  from  being  able  to  transmit  or  receive  messages  or  act  possitively 
to  achieve  the  goal.  In  the  military  context,  it  is  possible  that  an  agent  could  be 
destroyed  or  killed.  The  degree  to  which  this  loss  affects  the  group  is  related  to 
several  factors: 
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•  the  relevancy  of  the  lost  information  or  ability  with  respect  to 
the  comman-^  situation  or  scenario. 

•  the  amount  of  information  or  capability  lost  that  is  not  shared 
by  any  of  the  other  agents. 

•  the  characteristics  of  the  specific  communication  protocol. 

•  Transmission  Characteristics:  Always  present  in  any  computer-based 
communication  situation  are  the  physical  problems  associated  with  transmitting 
messages.  The  degree  to  which  these  characteristics  affect  the  problem  solving 
process  depends  upon  the  severity  of  each,  the  characteristics  of  the  situation  at 
hand,  and  the  characteristics  of  the  specific  communication  protocol.  These 
problems  usually  include: 

•  transmission  time;  amount  of  time  needed  to  send  a  message. 

•  delay  in  receiving  a  message;  the  capabilities  of  the  receptor 

facility  or  channel  could  delay  the  reception  of  a  message. 

«  accuracy  of  each  transmission;  errors  or  other  events  may 
occur  in  transmission  which  could  possibly  change  the 
meaning  of  the  message  or  simply  make  it  unintelligible. 

•  Timeliness  of  Data:  Unlike  the  physical  aspect  of  transmission 
characteristics,  timeliness  of  data  refers  to  the  currency  of  the  information  either 
being  sent  or  received.  Data  can  be  very  accurate  and  can  be  transmitted 
efficiently  through  communication  channels,  but  if  it  is  not  current  and  relevant  to 
the  situation  at  that  moment,  it  is  untimely.  The  degree  to  which  it  affects  the 
problem  solving  process  depends  upon  the  relevancy  of  the  data  with  respect  to 
the  command  situation  and  the  scenario  and  the  characteristics  of  the  specific 
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communication  protocol.  Figure  2  summarizes  the  cost  factors  which  must  be 

considered  in  assessing  the  environmental  conditions  of  the  situation. 

3.4.2  RISK  FACTORS:  Risk  factors  can  be  defined  as  deleterious 
characteristics  of  the  envircnment  or  instances  in  the  scenario  that  have  a  certain 
probability  of  occurence.  The  associated  consequences  of  these  factors  are  considered 
to  be  costly  but  the  occurence  of  the  factor  itself  is  not  deterministic.  For  example,  in  the 
military  environment,  a  threat  of  detection  can  exist.  The  risk  associated  with  that  threat 
is  a  function  of  three  conditions: 

•  friendly  collector,  or  sensor,  characteristics;  passive  or  "invisible" 
sensors  may  reduce  the  risk  of  detection. 

•  enemy  detection  capabilities;  the  more  sophisticated  their 
capabilities,  the  higher  the  probability  of  detection. 

•  characteristics  of  the  specific  communication  protocol. 

Message  interception,  another  prevalent  communication  risk  within  distributed  problem 
solving  situations,  is  also  a  function  of  three  conditions: 

•  friendly  message  protection  capabilities  (e.g.,  cryptic  codes). 

•  enemy  interception  and  interpretation  capabilities  (e.g.,  intelligence 
capabilities). 

•  characteristics  of  the  specific  communication  protocol. 
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Cost  Factors 


The  degree  to  which  these  risks  affect  the  problem  solving  process  depends  upon  the 
consequences  associated  with  the  risks.  In  addition,  it  depends  upon  the  selection  of  the 
communication  protocol  and  how  it  may  increase  or  decrease  the  risk  within  the 
command  situation.  Figure  3  shows  the  risk  factors  which  could  be  associated  with  a 
distributed  problem  solving  situation. 

3.5  KNOWLEDGE  REQUIREMENTS 

During  the  problem  solving  process,  the  Intelligent  Executive  is  responsible  for  1) 
monitoring  several  aspects  of  the  environment  and  scenario,  2)  maintaining  a  knowledge 
base  of  the  problem  objective,  and  3)  maintaining  and  updating  a  knowledge  base  of  the 
agents'  informational  needs.  By  doing  so,  the  Intelligent  Executive  can  achieve  its  goal 
of  assigning  the  appropriate  communication  protocol  to  the  group  at  any  point  in  time. 
However,  there  is  an  assumption  that  the  Intelligent  Executive  possesses  the  knowledge 
and  resources  required  to  execute  a  process  for  achieving  this  goal.  The  specific 
knowledge  required  by  the  Intelligent  Executive  will  be  described  within  the  distributed 
problem  solving  paradigm  presented  in  Section  1.0 

The  first  of  two  necessary  types  of  knowledge  which  must  be  embodied  within  the 
Intelligent  Executive  is  technically  known  as  "domain  knowledge."  Domain  knowledge  is 
the  knowledge  required  of  the  domain-specific  aspects  of  the  problem  solving  situation. 
Figure  4  is  an  amplification  of  Figure  1  in  Section  1.0  which  describes  the  overall 
distributed  problem  solving  situation.  However,  Figure  4  contains  additional 
characteristics  of  the  distributed  problem  solving  situation  which  are  relevant  to  defining 
the  domain  knowledge  requirements  of  the  Intelligent  Executive.  Each  of  the  six 
drawings  in  Figure  4  highlights  a  portion  of  the  knowledge  bases  of  one  or  more  of  the 


32 


33 


Figure  3. 
Risk  Factors 


agents  (knowledge  sources).  These  portions  of  the  knowledge  bases  must  be  shared 
with  one  or  more  other  agents  in  order  to  increase  the  shared  knowledge  space  (R) 
common  to  all  agents.  The  Intelligent  Executive  must  somehow  be  aware  of,  or  estimate 
the  differences  between,  these  knowledge  portions. 

The  ability  of  the  Intelligent  Executive  to  be  aware  of  the  different  aspects  of  the 
domain  knowledge  is  embodied  in  the  interpretation  the  Intelligent  Executive  gives  this 
knowledge.  Figure  5  represents  the  types  of  domain  knov^ledge  contained  within  the 
Intelligent  Executive.  The  difference  between  Figure  5  and  Figure  1  is  that  the 
knowledge  components  of  Figure  5  are  high-level  abstractions  of  the  knowledge 
components  of  Figure  1.  For  example,  the  knowledge  contained  within  knowledge 
sources  A,  B  and  C  of  Figure  1  is  abstracted  ir  Figure  5  so  that  the  Intelligent  Executive 
knows  the  type  of  knowledge  embodied  in  A,  B  and  C  but  not  necessarily  the  specific 
knowledge.  The  body  of  knowledge,  R*.  that  must  be  shared  by  the  agents  to  be  able  to 
reach  a  solution  is  abstracted  so  that  the  Intelligent  Executive  knows  what  aspects  of 
certain  types  of  knowledge  must  be  common  among  the  agents.  The  same  argument 
that  holds  for  R*  is  true  for  the  body  of  knowledge  labeled  R.  It  represents  the  aspects 
of  knowledge  that  the  agents  currently  have  in  common.  Finally,  the  knowledge 
specified  by  a,  b,  c,  d,  e,  and  f  in  Figure  4  are  abstracted  in  Figure  5  as  the  aspects  of 
relevant  knowledge  which  must  be  communicated  among  the  agents  in  order  for  the 
amount  of  shared  knowledge,  R,  to  increase. 
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Figure  5. 

Intelligent  Executive  Interpretation  of  Domain  Knowledge 
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The  definitions  above  represent  the  intelligent  agents  and  their  knowledge 
relationships  with  respect  to  one  another.  However,  these  relationships  do  not  exist  in 
vacuum.  The  contextual  backdrop  in  which  they  communicate  and  cooperate  is  also 
represented  in  Figure  5.  It  contains  the  bounded  problem  environment,  the  scenario  and 
its  relevant  entities,  and  the  problem  solving  objective.  These  are  the  components  of  the 
situation  that  not  only  drive  the  need  for  the  agents  to  cor.,  ^unicate  but  circumscribe  the 
requirements  of  the  knowledge  componentsdefined  as  R,  R’,  a,  b,  c,  d,  e.  and  f.  The 
definition  of  these  components  depends  on  the  contextual  backdrop  in  which  the 
problem  solving  process  takes  place.  Therefore,  the  Intelligent  Executive  must  keep  up 
with  the  environmental  components  to  maintain  its  knowlege  base. 

The  second  type  of  knowledge  that  must  be  embodied  within  the  Intelligent 
Executive  is  "control  knowledge".  It  is  this  knowledge  that  endows  the  Intelligent 
Executive  with  the  capability  to  assess  the  problem  solving  situation  (domain 
information)  and  determine  the  appropriate  communication  strategy  or  protocol  tor  that 
situation.  Table  3  summarizes  the  domain  and  control  knowledge  which  must  exist 
within  the  Intelligent  Executive. 

This  section  has  presented  the  functional  requirements  of  the  Intelligent  Executive 
in  terms  of  the  communication  protocols  it  must  be  able  to  specify  and  enforce,  the 
tactical  command  situation  within  which  it  must  operate,  the  communication  factors,  both 
risk  and  cost,  that  influence  the  manner  in  which  the  Intelligent  Executive  interprets  the 
environment  and  the  knowledge  required  for  the  Intelligent  Executive  to  effectively 
operate  in  a  distributed  problem  solving  environment. 
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Table  3. 

Intelligent  Executive  Domain  and  Control  Knowledge 


_ DOr.lAiN  KNOWLEDGE  REQUIREMENTS _ 

•  Types  of  knowledge  embodied  in  intelligent  agents 

•  Aspects  of  common  knowledge  among  agents  required  to 
obtain  a  solution 

•  Aspects  of  common  knowledge  that  exists  among  agents 

•  Aspects  of  relevant  knowledge  which  must  be  communicated 

•  Bounded  problem  environment 

•  Scenario  and  its  relevant  entities 

•  Problem  solving  objective 

_ CONTROL  KNOWLEDGE  REQUIREMENTS _ 

•  Criteria  for  determining  the  appropriate  communication 

protocol  at  any  point  during  the  solution  process 


4.0  INTELLIGENT  EXECUTIVE  CONCEPT  OF  OPERATION 


I 

4.1  OVERVIEW 


As  a  specifier  of  communication  strategies,  the  Intelligent  Executive  must  be  able 
to  assess  the  cost  and  risk  factors  associated  with  the  environment  and  determine  how 
their  severity  varies  with  different  communication  protocols.  Therefore,  the  Intelligent 
Executive  must  have  a  framework  for  assessing  these  factors  and  their  importance  within 
the  command  situation.  The  framework  must  provide  criteria  for  selecting  the  appropriate 
communication  protocol  for  the  group. 

The  following  is  a  framework  for  allowing  the  Intelligent  Executive  to  assess  the 
appropriate  communication  protocol  for  a  group  of  agents  during  the  solution  process. 
Specifically,  the  framework  allows  the  Intelligent  Executive  to  minimize  an  objective 
function  which  incorporates  the  effects  of  the  command  situation,  the  scenario,  the 
environment,  the  cost  factors  and  the  risk  factors  associated  with  the  overall  mission. 

4.2  CONCEPTUAL  FRAMEWORK 

It  can  be  assumed,  based  on  the  military  contextual  backdrop,  that  in  order  to 
assess,  plan  or  act  effectively  the  agents  must  collect  information  about  the  environment 
as  accurately  as  possible.  In  addition,  while  pursuing  this  objective,  it  is  required  that  the 
agents  minimize  the  costs  and  risks  associated  with  their  pursuit.  For  the  purpose  of 
defining  a  conceptual  framework  in  which  the  Intelligent  Executive  operates,  a  military 
command  situation  is  presented  by  defining  the  objective  of  the  mission  to  be  situation 
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assessment.  In  addition,  the  only  risk  which  will  be  associated  with  the  environment  will 
be  the  probability  of  detection  by  the  enemy. 

Therefore,  the  objective  function,  F,  can  be  described  as: 

F  =  min  f[E(d),  E(c)] 
where 

E(d)  =  expected  cost  of  detection 

E(e)  =  expected  cost  of  error  in  situation  assessment 

The  elements  which  describe  the  objective  function  (e.g.,  E(d)  and  E(e))  represent  the 
elements  of  the  distributed  problem  solvers'  tradeoff  condition.  The  expected  cost  of 
error  in  situation  assessment,  E(e),  represents  the  struggle  of  the  problem  solver  to 
overcome  environmental  cost  factors  which  inhibit  the  flow  of  information  and,  therefore, 
the  problem  solving  process.  The  expected  cost  of  detection,  E(d),  represents  the 
environmental  risk  associated  with  the  attempts  to  acquire  the  information  necessary  to 
assess  the  situation.  The  specific  definitions  of  each  of  these  elements  will  be  stated 
below. 

It  is  assumed,  for  the  sake  of  simplicity  in  specification,  that  the  function  describing 
the  relationship  between  E(d)  and  E(e)  is  additive  (although  future  experimentation 
may  very  well  prove  otherwise).  Therefore: 

F  =  min  [aE(d)  +  bE(e)] 
where 

a  =  f(importance  of  E(d)  within  the  command  situation) 
b  =  f(importance  of  E(e)  within  the  command  situation) 
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The  representation  of  the  objective  function  as  shown  above  provides  a  mechanism  for 
specifying  the  relative  importance  of  the  need  for  information  and  the  risk  associated  with 
trying  to  obtain  it.  In  some  situations,  the  value  of  a  will  be  larger  than  the  value  of  b. 

This  implies  that  the  importance  of  the  risk  associated  with  communication  is  greater  than 
the  importance  of  need  for  accurate  information. 

The  expected  costs  of  both  detection  and  error  in  situation  assessment  can  be 
defined  in  terms  of  the  command  situation  and  the  communication  factors  discussed 
earlier.  Therefore: 

E(d)  =  C(d)  P(d) 
where 

C(d)  =  cost  of  detection 
=  f(command  situation) 

P(d)  =  probability  of  detection 

=  f(sensor  environment,  both  friendly  and  enemy,  characteristics  of  the 
communication  protocol) 
and 


E(e)  =  C(e)  P(e) 
where 

C(e)  =  cost  of  error  in  situation  assessment 
=  f(command  situation) 

P(e)  =  probability  of  error  In  situation  assessment 
=  f(agent  availability/unavailability,  transmission, 

characteristics,  timeliness  of  data,  agent  stress  level,  It) 

Table  4  shows  the  respective  descriptions  of  C(d)  and  C(e)  for  each  command 
situation. 
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Table  4. 

Costs  per  Command  Situation 


2 


-  enemy  may  intercept  forces  and  prevent 
withdrawal 


The  term  It  in  the  specification  of  P(e)  refers  to  the  degree  of 
information  overlap  between  agents  in  the  group  at  any  point  in  time  t.  During  each 
solution  process,  there  exists  a  backdrop  of  shared  information  between  the  agents. 
Ordinarily,  the  more  relevant  information  the  agents  have  in  common,  the  easier  it  is  for 
them  to  communicate  with  each  other.  But  this  common  information  increases  the  ability 
to  reach  a  solution  quickly  only  it  its  "size"  is  significant  with  respect  to  the  amount  of 
common  information  necessary  to  reach  a  solution  to  the  problem.  Referring  to  Figure  6, 
this  shared  information  can  be  described  as  the  ratio  between  the  amount  of  common 
information  between  the  agents  at  any  point  in  time  (R)  and  the  total  amount  of  common 
information  which  the  agents  must  share  in  order  to  be  able  to  reach  a  solution  (R’). 


R  _  amount  of  common  information  at  time  t 

R'  total  amount  of  common  information  required 

to  be  able  to  reach  solution 


As  the  value  of  Ij  increases,  the  value  of  P(e)  would  tend  to  decrease  (all  other  factors 


being  equal).  One  assumption  has  been  made  in  the  design  of  the  framework  in  which 
the  Intelligent  Executive's  operates.  It  is  embodied  in  the  fact  that  no  one  agent 
"outranks"  any  other  agent  within  the  group.  Agents  are  allowed  to  communicate  with 
any  agent  while  keeping  with  the  specified  communication  protocol. 
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The  framework  presented  above  describes  the  concept  of  an  Intelligent  Executive. 
By  assessing  the  critical  elements  of  a  problem  situation  which  afiect  the  selection  of  a 
communication  protocol,  the  Intelligent  Executive  is  able  to  facilitate  the  process  of 
distributed  problem  solving.  The  following  section  will  present  the  concept  of  operation 
of  the  Intelligent  Executive  that  would  be  used  to  ultimately  select  the  appropriate 
communication  strategy  for  the  group. 

4.3  CONCEPT  OF  OPERATION 

The  concept  of  operation  consists  of  seven  steps  which  will  be  described  below.  It 
is  by  this  process  that  the  Intelligent  Executive  will  behave  in  its  role  of  communication 
protocol  selector.  As  the  distributed  group  of  agents  proceed  with  the  problem  solving 
process,  the  Intelligent  Executive  must  invoke  this  algorithm  to  assess  the 
communication  requirements  of  the  group.  The  Intelligent  Executive  begins  this  process 
from  the  start  of  the  problem  scenario,  performs  it  continuously  throughout  the  problem 
solving  process,  and  concludes  it  when  the  intelligent  agents  have  reached  a  solution  to 
the  problem  or  when  the  problem  ceases  to  exist. 

A  concept  of  operation  that  is  based  on  the  conceptual  framework  just  presented 
will  provide  the  mechanism  for  allowing  the  Intelligent  Executive  to  achieve  this 
objective.  This  approach  is  described  in  Figure  7.  The  process,  which  consists  of  seven 
separate  steps,  is  outlined  below. 
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j  =  command  situation 
A’  =  abstraction  of  knowledge  source  A 
B*  =  abstraction  of  knowledge  source  B 
C  =  abstraction  of  knowledge  source  C 
R  =  shared  knowledge 
R  •  =  solution  requirements 
a  =  knowledge  to  be  shared  by  A  with  B  and  C 

b  =  knowledge  to  be  shared  by  B  with  A  and  C 

c  =  knowledge  to  be  shared  by  C  with  A  and  B 

d  =  knowledge  to  be  shared  by  A  and  B  with  C 

e  =  knowledge  to  be  shared  by  A  and  C  with  B 

I  =  knowledge  to  be  shared  by  B  and  C  with  A 

I I  =  degree  of  information  overlap 
P(d  I  )  =  probability  of  detection 

P(e  I  )  =  probability  of  erro; 

C(d  j  )  =  cost  of  detection 
C(e  I  )  =  cost  of  error 

a  j  =  f(importance  of  expected  cost  of  detection) 
b  1  =  f(impottance  of  expected  cost  of  error) 

E(d  ij  )=  expected  cost  of  detection 

E(e  I]  )=  expected  cost  of  error _ 
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Figure  7. 

Intelligent  Executive  Concept  of  Operation 
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step  1:  Assess  It- 

The  Intelligent  Executive  must  assess  the  ratio  of  R  (the  amount  of  common 
information  shared  by  the  agents  at  time  t)  to  R*  (the  total  amount  of  common 
nformation  that  must  be  shared  in  order  for  the  agents  to  be  able  to  reach  a 
solution). 

Step  2:  For  each  communication  protocol  i,  compute  P(dj)  and  P(ei). 

The  values  of  the  probability  of  detection,  P(di),  are  to  be  calculated  for  each 
communication  protocol.  Aspects  of  the  environment  which  contribute  to  the 
assessment  are  the  characteristics  of  the  friendly  sensors,  enemy  detection 
capabilities,  and  communication  protocol  characteristics.  Calculation  of  the 
values  of  the  probability  of  error,  P(ei).  is  a  function  of  agent 

availability/unavailability,  transmission  characteristics,  timeliness  of  data,  the 
value  of  It,  and  the  communication  protocol  characteristics. 

Step  3:  For  the  current  command  situation  j,  assess  C(dj),  C(ej),  aj 
and  bj. 

The  costs  of  being  detected,  C(dj),  and  of  making  an  error  in  situation 
assessment,  C(ej),  are  both  functions  of  the  command  situation  at  hand.  The 
relative  importance  of  detection  and  situation  assessment  (the  values  of  aj  and  bj) 
are  also  functions  of  the  current  command  situation. 

Step  4:  Compute  E(ejj)  and  E(dij). 

The  expected  costs  of  error  in  situation  assessment  and  detection  are 
computed  based  on  the  attendant  values  of  probability  and  costs  assessed  in  the 
previous  steps. 

E(eij)  =  C(ej)  P(e|) 

E(djj)  =  C(dj)  P(di) 
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step  5:  Compute  the  objective  function,  F|j. 

The  objective  function  is  computed  for  each  communication  protocol  I  and  the 
current  command  situation  j. 

f^ij  =  [9jE(dij}  +  biE(eij)] 

Step  6  :  Determine  min  (Fjj)  =  F|min,j. 

The  three  values  of  Fjj  are  compared  and  the  minimum  value  is  selected.  This 
value  ensures  that  the  communication  protocol  selected  (imin)  for  the  group 
satisfies  the  objective  that  the  detection  risk  and  the  error  costs  are  kept  at  a 
minimum. 

Step  7:  Assign  the  communication  protocol  i^in  to  the  group  of  agents. 

At  this  point,  the  Intelligent  Executive  will  dictate  the  most  appropriate 
communication  protocol  for  the  agents  to  follow  which  will  facilitate  their  problem 
solving  process  in  the  most  efficient  manner. 


4.4  SELECTION  ENVIRONMENT 


By  following  the  seven  step  process  described  above,  the  Intelligent  Executive 
would  produce  results  similar  to  that  in  Figure  8  for  the  current  command  situation  (j). 

The  objective  function  values  (Fjj)  for  each  communication  protocol  (I)  would  be 

compared  and  the  Intelligent  Executive  would  select  the  appropriate  communication 
strategy.  In  the  case  of  Figure  8,  the  Selective  communication  protocol  would  be  initiated 
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Figure  8. 

Intelligent  Executive  Computational  Results 


with  a  group  of  agents.  However,  circumstances  surrounding  the  problem  situation  may 
impose  constraints  on  the  selection  process  such  that  the  minimum  value  of  Fjj  is  not 

necessarily  chosen.  For  instance,  there  may  exist  a  maximum  acceptable  level  for  the 
value  of  E(djj),  in  which  case,  the  communication  protocol  selected  may  not  offer  the 

most  desirable  environment  but  will  satisfy  all  of  the  external  constraints.  Figure  9 
shows  how  this  may  happen.  Although  the  Selective  communication  protocol  offers  the 
lowest  value  of  the  objective  function,  the  value  of  E(dsj)  is  above  the  maximum 

acceptable  level.  Therefore,  the  Autonomous  protocol  is  the  only  solution  to  the 
selection  process.  Figure  10  describes  a  similar  situation  in  which  E(eij)  is  constrained 

with  a  maximum  allowable  value.  In  this  case,  the  only  viable  solution  is  the  selection  of 
the  Broadcast  protocol  which  satisfies  the  constraint. 

In  essence,  there  are  three  solution  possiblities  which  can  exist.  They  are 
described  below. 

Case  1;  Select  min  (Fjj). 

In  this  case,  there  are  no  external  constraints  placed  on  any  of  the  values  leading 
to  the  solution.  Therefore,  it  is  simply  a  case  of  selecting  the  minimum  value  of  F|j. 

Case  2:  Select  min  (Fjj)  such  that  E(dij)  <  E(dij)max- 

External  constraints  are  placed  on  the  value  of  E(d|j).  Therefore,  any  value  of  Fjj 
which  is  comprised  of  a  value  E(dij)  >  E(djj)max 's  ineligible  for  consideration. 
The  minimum  value  of  Fjj  of  the  remaining  candidates  is  then  selected  and 
assigned  to  the  group. 


50 


Assumptions 


•  t)3  PUE  ( 


(I 


3)3  }0  S9nieA  &JISE3XXJ1 


uojpunj  aAipafqo  jo  sanpA  SuiSEajoui 


51 


Figure  9. 

External  Constraints  on  Expected  Cost  of  Detection 
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Case  3;  Select  min  (Fjj)  such  that  E(ejj)  <  E(ejj)^ax- 

This  situation  is  similar  to  Case  2  except  that  the  external  constraint  is  placed  on 
the  value  of  E(eij)  instead  of  E(d|j). 

Case  4;  Select  min  (Fij)  such  that  E(djj)  <  E(djj)n,ax  arid  E{ejj)  <  E(ejj)max- 

In  some  cases,  external  constraints  prohibit  the  possibility  of  a  solution  at  all.  For 
example,  if  the  situations  in  Figures  9  and  10  existed  simultaneously,  there  would 
be  no  communication  protocol  which  would  satisfy  all  of  the  constraints. 
Consequently,  the  Intelligent  Executive  would  have  to  rely  on  a  "back-up"  strategy. 
These  may  include: 

•  maintain  current  communication  protocol. 

•  begin  to  relax  "least  important"  constraint  until  a  protocol  can 
be  selected. 

•  revert  to  Autonomous  protocol  (most  conservative  strategy). 

This  section  has  presented  a  functional  framework  and  execution  process  by 
which  the  Intelligent  Executive  will  behave  in  its  role  as  communication  protocol  selector. 
This  approach  is  based  on  an  algorithmic  method.  The  inputs  through  which  the 
algorithm  executes  include  aspects  of  the  problem  environment  and  knowledge 
characteristics  of  the  intelligent  agents  within  the  group.  With  the  specified  inputs  and 
the  mechanism  to  execute  the  process,  the  Intelligent  Executive  becomes  a  fundamental 
component  of  the  distributed  problem  solving  environment. 
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5.0  CONCLUSIONS 


5.1  OVERVIEW 

Communication,  both  with  respect  to  protocol  and  content,  plays  a  critical  role  in 
distributed  problem  solving  situations.  However,  a  systematic  approach  for  determining 
the  appropriate  communication  strategy  for  a  particular  situation  has  not  been  formally 
put  forth  by  the  research  community  as  yet.  This  report  suggests  that  it  is  worthwhile  to 
consider  a  method  by  which  different  communication  strategies  can  be  practiced  or  even 
evaluated  within  various  contexts  and  under  different  degrees  of  risk  and  cost. 
Specifically,  this  report  presented  the  functional  requirements  of  an  Intelligent  Executive 
and  its  concept  of  operation.  The  Intelligent  Executive  presented  evaluates  a  situation 
and  suggests  an  appropriate  communication  protocol  for  the  group.  The  framework 
presented  defines,  not  only  the  concept  by  which  the  Intelligent  Executive  performs  its 
functions,  but  the  knowledge  that  the  Intelligent  Executive  must  possess  to  provide 
meaningful  results. 

In  an  operational  context,  the  Intelligent  Executive  could  serve  as  a  controller  of 
communication.  However,  the  possibilities  for  use  of  the  Intelligent  Executive  go  well 
beyond  the  purely  operational  environment.  A  natural  setting  for  this  concept  is  within  a 
testbed  environment  for  the  purposes  of  evaluating  distributed  problem  solving 
strategies.  In  any  time-varying  domain.  In  each  of  these  settings,  the  Intelligent  Executive 
could  serve  as  a  simulation  tool  for  evaluating  agent  interactions  and  communication  or 
novel  problem  solving  strategies.  The  results  of  these  types  of  simulations  would  be 
extremely  valuable  to  the  field  of  distributed  problem  solving  in  that  they  would  guide  the 
development  of  communication  and  cooperation  strategies  in  those  environments. 

Although  this  report  provides  a  framework  for  specifying  the  functionality  of  an 
Intelligent  Executive,  there  are  many  issues  which  still  must  be  addressed  before 
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implementation  of  such  a  concept  becomes  reality.  These  issues  can  help  provide 
guidelines  for  defining  future  research.  These  types  of  research  must  be  pursued  to 
eventually  realize  a  functioning  Intelligent  Executive. 

In  summary,  this  report  presents  a  framework  under  which  the  research  issues 
surrounding  the  Intelligent  Executive  concept  can  be  addressed.  The  following 
experimental  plan  describes  the  objectives,  the  environment  and  the  variables  which 
could  exist  in  a  laboratory  setting  for  the  purposes  of  specifying  the  functional 
components  of  an  Intelligent  Executive. 

5.2  EXPERIMENTAL  OBJECTIVE 

The  experimental  framework  is  designed  to  facilitate  the  study  of  distributed 
problem  solving  groups.  The  behavior  of  such  groups  is  examined  in  a  simulated, 
dynamic  problem  solving  environment.  The  focus  of  the  experimental  plan  is  to  provide 
a  controlled  environment  for  addressing  issues  such  as  the  effects  of  varying 
communication  protocols  on  the  group's  problem  solving  effectiveness:  the  effects  of 
varying  command  situations  and  their  associated  cost  and  risk  factors  on  the 
probabilities  of  error  and  detection/interception;  and  the  evaluation  of  an  objective 
function  for  specific  problem  situations. 

5.3  EXPERIMENTAL  SET-UP 

The  proposed  experimental  set-up  is  based  on  a  network  of  personal  or  micro 
computers  (preferably  three  agent  nodes  and  one  coordinator  or  experimenter  node). 
The  role  of  the  computer  in  this  set-up  is  primarily  to  provide  a  medium  for 
communication  among  the  intelligent  agents.  However,  the  computer  also  allows  the 
experimenter  to  manipulate  the  problem  environment.  In  addition,  the  computer 


maintains  a  record  of  the  agents'  actions  and  provides  a  facility  for  viewing  the  group's 
solution  as  it  evolves. 

The  experimental  task  places  a  group  of  three  agents  in  a  battlefield  situation. 

The  agents  are  given  a  "God's-eye  view"  of  a  dynamic  battlefield  environment  and  are 
asked  to  ultimately  "assess"  the  battlefield  situation.  In  order  to  do  so,  the  agents  are 
given  the  ability  to  communicate  with  each  other.  They  are  allowed  to  transmit  messages 
to  each  other  (either  queries  or  statements)  concerning  the  battlefield  developments. 
However,  each  agent  only  sees  a  "portion"  of  the  overall  battlefield.  Although  their 
portions  may  overlap  somewhat,  no  two  agents  have  the  same  information  available  to 
them.  In  addition,  not  every  portion  of  the  situation  is  seen  by  at  least  one  agent.  This 
set-up  is  characteristic  of  most  distributed  problem  solving  environments.  The  agents 
have  some  common  information  but  as  a  group  they  do  not  always  have  the  "total 
picture." 

The  specific  task  the  agents  must  perform  has  its  roots  in  situation  assessment. 
The  agents  are  instructed  to  observe  and  assess  the  dynamic  battlefield  situation.  Their 
task  is  to  arrive,  as  best  as  they  can,  at  an  interpretation  of  what  is  going  on  in  the  overall 
situation.  To  achieve  this  goal,  the  agents  must  communicate  and  cooperate  with  one 
another  in  order  to  better  understand  the  entire  environment. 

5.4  EXPERIMENTAL  VARIABLES 

Although  the  agents  are  given  a  facility  for  communicating,  several  constraints 
may  be  placed  on  their  actions.  The  variables  within  this  experimental  set-up  which  may 
be  used  as  constraints  on  the  agents'  interactions  are  described  below. 
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5.4.1  Communication  protocols 

Communication  strategies  may  be  varied  in  order  to  observe  the  effects  on  end 
perforrrance  or  even  on  the  process  by  which  the  agents  achieve  their  performance. 
Several  communication  protocols  such  as  Broadcast,  Selective  or  Autonomous  may  be 
used  to  constrain/unconstrain  the  interactions  between  agents. 

5.4.2  Command  situations 

The  command  situations  or  the  objective  of  the  situation  could  be  varied  in  order 
to  study  the  communication  and  cooperation  strategies  employed  by  the  agents  in 
different  situations.  In  addition,  with  each  command  situation,  the  costs  of 
detection/interception  and  the  costs  of  error  in  situation  assessment  may  vary.  Therefore, 
the  effects  of  these  changes  on  the  agents*  actions  can  be  studied. 

5.4.3  Probability  of  detection/interception 

The  extent  to  which  communication  has  its  consequences  is  reflected  in  the 
probability  of  detection/interception  by  the  enemy  in  the  scenario.  Varying  this  parameter 
may  change  the  strategies  chosen  by  the  agents  and/or  their  effectiveness  in  solving  the 
problem. 

5.4.4  Time 

This  variable  is  usually  designed  to  induce  stress  within  the  group  performing  the 
task.  However,  giving  the  group  an  indefinite  amount  of  time  may  also  affect  the 
behavior  of  the  agents. 

5.4.5  Amount  of  common  information 
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The  "portions"  of  the  battlefield  situation  which  can  be  viewed  by 
each  agent  can  be  varied  so  that  they  view  more/less  of  the  same  information,  the  group 
views  more/less  of  the  total  situation  or  a  combination  of  thetwo.  The  degree  to  which 
their  portions  overlap  may  affect  the  agents’  problem  solving  process  and/or  their  end 
performance. 

5.5  SUMMARY 


There  are  many  possible  combinations  of  constraints  that  can  be  placed  on  the 
experimental  set-up  described  above;  however,  the  constraints  chosen  for  any  particular 
experiment  are  indicative  of  the  results  which  are  desired  from  it.  In  other  words,  the 
proposed  experimental  set-up  can  be  viewed  as  a  testbed  for  defining  the  functional 
components  of  an  Intelligent  Executive.  The  testbed  could  be  used  to  study  the 
sensitivities  wiich  exist  between  the  many  variables  in  a  distributed  problem  solving 
situation. 

Finally,  it  is  not  suggested  that  this  experimental  set-up  provides  total  coverage  of 
all  relevant  issues  to  be  pursued  in  the  field  of  distributed  problem  solving.  This  set-up  is 
aimed  at  those  issues  that  are  specifically  related  to  the  ultimate  development  of  an 
Intelligent  Executive.  However,  it  is  suggested  that  in  the  process  of  resolving  many  of 
these  issues  important  lessons  can  be  learned  to  further,  not  only  the  insight  into  the 
functionality  of  an  Intelligent  Executive,  but  the  field  of  distributed  problem  solving  as  a 
whole. 
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